View synthesis of articulating humans using visual hull
نویسندگان
چکیده
In this paper, we present a method which combines imagebased visual hull and human body part segmentation for overcoming the inability of the visual hull method to reconstruct concave regions. The virtual silhouette image corresponding to the given viewing direction is first produced with image-based visual hull. Human body part localization technique is used to segment the input images and the rendered virtual silhouette image into convex body parts. The body parts in the virtual view are generated separately from the corresponding body parts in the input views and then assembled together. The previously rendered silhouette image is used to locate the corresponding body parts in input views and avoid the unconnected or squeezed regions in the assembled final view. Experiments show that this method can improve the reconstruction of concave regions for human postures and texture
منابع مشابه
View Synthesis from Image and Video for Object Recognition Applications
Title of Dissertation: View Synthesis from Image and Video for Object Recognition Applications Zhanfeng Yue, Doctor of Philosophy, 2007 Dissertation directed by: Professor Rama Chellappa Department of Electrical and Computer Engineering Object recognition is one of the most important and successful applications in computer vision community. The varying appearances of the test object due to diff...
متن کاملSafe Hulls
The visual hull is widely used as a proxy for novel view synthesis in computer vision. This paper introduces the safe hull, the first visual hull reconstruction technique to produce a surface containing only foreground parts. A theoretical basis underlies this novel approach which, unlike any previous work, can also identify phantom volumes attached to real objects. Using an image-based method,...
متن کاملTowards real-time novel view synthesis using visual hulls
This thesis discusses fast novel view synthesis from multiple images taken from different viewpoints. We propose several new algorithms that take advantage of modern graphics hardware to create novel views. Although different approaches are explored, one geometry representation, the visual hull, is employed throughout our work. First the visual hull plays an auxiliary role and assists in recons...
متن کاملView Synthesis using Convex and Visual Hulls
This paper discusses two efficient methods for image based rendering. Both algorithms approximate the world object. One uses the convex hull and the other uses the visual hull. We show that the overhead of using the latter is not always justified and in some cases, might even hurt. We demonstrate the method on real images from a studio-like setting in which many cameras are used, after a simple...
متن کاملNovel view image synthesis based on photo-consistent 3D model deformation
In this paper, a system is designed for improving the quality of novel view synthesis. To make the virtual view synthesis look better, the basic idea is to perform model refinement with important camera information of the novel view. In this system, we first use the reconstructed visual hull from shape from silhouette and then refine this 3D model based on the view dependency. The 3D points of ...
متن کامل